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What is the hmit of information storage capacity of discrete spin systems? To answer this question, 
we study classical error-correcting codes which can be physically realized as the energy ground space 
of gapped local Hamiltonians. For discrete spin systems on a D-dimensional lattice governed by 
local frustration-free Hamiltonians, the following bound is known to hold; kS^^ < 0(n) where k is 
the number of encodable logical bits, d is the code distance, and n is the total number of spins in 
the system. Yet, previously found codes were far below this bound and it remained open whether 
there exists an error-correcting code which saturates the bound or not. Here, we give a construction 
of local spin systems which saturate the bound asymptotically with k ~ 0{L^~^) and d ~ 0{L^~'^) 
for an arbitrary small e > where L is the linear length of the system. Our model borrows an idea 
from a fractal geometry arising in Sierpinski triangle. 



I. INTRODUCTION AND SUMMARY OF RESULTS 

Understanding the limits imposed on information storage capacity of physical systems is a problem of fundamental 
and practical importance which bridges physics and information science [Tj. This problem has been addressed for 
continuum systems by Bekenstein [5]. He showed that it is impossible to store an infinite amount of information on 
a finite system and derived the well-celebrated bound on the number of logical bits that can be stored inside a finite 
region: 
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where S is the amount of information stored, L is the linear length of the region, and E is the total energy. 

The most beautiful outcome concerning the Bekenstein bound is that black holes saturate this theoretical limit [Sj . 
This is essentially due to the observation that an object with a large amount of information (entropy) tends to 
have high energy, and will eventually turn into a black hole once its energy exceeds a critical value. This surprising 
connection between information theory and black hole physics is at the heart of the thermodynamic treatment of 
black holes and the holographic principle [3]. 
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FIG. 1: (a) Storage of information in discrete spin systems via local interactions, (b) A theoretical upper bound on information 
storage capacity for D = 2. The graph is shown in a logarithmic scale. The dotted line represents a family of repetitive codes. 
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Recently, a similar question on information storage capacity for discrete spin systems on a lattice has been addressed. 
Consider discrete spin systems defined on a /^-dimensional lattice which is governed by a local frustration-free com- 
muting Hamiltonian where D is the spatial dimension. Then, the following bound is known to hold [S]: 

kd^^^ < 0(n) (2) 

where k is the number of encoded logical bits, d is the code distance, and n is the total number of spins when the 
energy ground space of the Hamiltonian is viewed as the codeword space of an error-correcting code. (Note that the 
code distance d is a quantitative measure of the robustness of encoded information against errors). Such spin systems, 
called local codes, cover a large class of physically realizable error-correcting codes, and may be viewed as low-density 
parity-check (LDPC) codes [B] constructed on a space with metric. 

Then, one may be naturally led to an analogous question on information storage capacity of discrete spin systems, 
concerning local codes which saturate the bound in Eq. (|2|. This is a problem of practical importance since such a 
local code would be the best error-correcting code that is physically realizable with local Hamiltonians. This problem 
is also of fundamental importance since such a local code may be viewed as an analog of a black hole for discrete 
spin systems, and may be useful for further establishing the connection between continuum and discrete descriptions 
of space-time and quantum gravity [71 H] . Such a local code may be a candidate of novel quantum phases arising in 
gapped correlated spin systems which are beyond descriptions of known effective theories. 

However, finding a local code which saturates the bound turned out to be a challenging problem. In particular, 
previously found local codes were far below the bound as seen in Fig. [ijb) . To gain some insights on the problem, 
let us look at a prototypical example of local codes on a two-dimensional lattice {D = 2). A repetitive code encodes 
and 1 into repetitions of zeros and ones; 000 • • • and 111 • • • , and can be physically realized as a local code through 
ferromagnetic interactions. Since a repetitive code encodes a single logical bit and the Hamming distance (i.e. the 
number of different spin values) between two codewords is n, it has k = I and d — n. On the other hand, for 
D = 2, the bound is ky/d < 0{n), and thus, the repetitive code is far below the theoretical limit. One may modify 
a repetitive code by splitting the entire lattice into smaller subparts and using them as individual repetitive codes. 
However, such a construction gives a family of local codes with kd = n as shown with a dotted line in Fig. [l|b), which 
is still below the bound. Therefore, in order to approach the theoretical limit, one needs to employ more complicated 
spin configurations instead of repetitive codes. 

In this paper, we present a construction of local codes, called fractal codes, which saturate the bound asymptotically: 

Theorem 1. There exists a local code which can approach the theoretical limit arbitrarily close: 

k^O{L^-^), 0{L^-') < d < 0{L°) (3) 
for D > 2 where e is an arbitrary small positive number, L is the linear length of the lattice and n — . 

Therefore, our construction gives the best physically realizable error-correcting code that is currently known. Note 
that k is area-like and d is asymptotically volume-like, and the area law naturally arises here. 

Our construction borrows an idea from a well-known example of fractal geometries. Sierpinski triangle has self- 
similar properties where the same patterns appear repeatedly at different length scales as shown in Fig. [2]Ja). This 
peculiar geometric nature of the triangle is reflected in its non-integer dimensionality where the number of filled 
elements Li°s3/iog2 gj-Qws as if the spatial dimension is ~ 1.585 with respect to the linear length of the lattice L. 
While it had been long thought that Sierpinski triangle is a mathematical object, it became apparent that it can be 
physically realized as a ground state of interacting spin systems via three-body terms . Fig [2](a) shows a physical 
realization of Sierpinski triangle on a square lattice where interaction terms are minimized when local constraints 
a + b = c (mod 2) on three neighboring spins are satisfied. It has been pointed out that such a fractal system may be 
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useful as an error-correcting code with an efficient decoder [10] . Recently, coding properties of this fractal code have 
been predicted as follows [S]: 



(4) 



based on numerical simulations where the fractal dimension of the code distance is equal to the fractal dimension of 
Sierpinski triangle. This prediction is also shown to be true for infinite lattices. Therefore, this fractal code may be 
significantly better than previously found local codes such as repetitive codes. 
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(b) p=3 
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FIG. 2: (a) Sierpinski triangle and its physical realization on a square lattice (p — 2). Filled elements are mapped to Is while 
unfilled elements are mapped to Os. Interaction terms are three-body, (b) A generalization of Sierpinski triangle (p — 3). Black 
elements are mapped to Is, grey elements are mapped to 2s, and unfilled elements are mapped to Os. 

Despite a remarkable idea of constructing a local code based on Sierpinski triangle, previous works have two serious 
drawbacks. First, this fractal code is still far below the theoretical limit as seen in Fig.flVb). Second, in order to prove 

log 3 ^ 

the prediction of d ^ 0(L'°s2)^ one needs to analyze Hamming distances between all the 2 ground states and find 
the minimal Hamming distance, which is a formidable challenge both from analytical and computational perspectives. 

We start by presenting the resolution of the first challenge. Our construction of fractal codes utilizes a generalization 
of Sierpinski triangle with higher-dimensional spins. To begin with, let us discuss fractal properties of Sierpinski 
triangle with three-dimensional spins where possible spin values are 0, 1,2 as shown in Fig. ^b). The number of 

log 6 1 

non-zero spins in this generalized Sierpinski triangle is Li°e3 ^ and its fractal dimension is ~ 1.631, which is larger 
than ^ 1.585. Then, one may naturally expect that this generalization gives a fractal code with k ^ 0(L) and 

log 6 

d 0{L^°<i^) where k is the number of encodable three-dimensional logical spins. 

The key observation here is that the fractal dimension of Sierpinski triangle grows as the inner dimension of spins 
increases. In particular, at the limit where p goes to infinity, we notice 

1 <- p(p+i) ', 

^ ^ ^ ' ^2 for p^oo. (5) 
logp 

Therefore, by taking sufficiently large p, one can construct a fractal code with k'^^^ ^ 0{L) and d > 0{L^~'^) for an 
arbitrary small e > where k^P^ is the number of encodable p-dimensional spins. This family of fractal codes based 
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on generalized Sierpinski triangle will saturate the bound in Eq. ([2| asymptotically. While our construction of fractal 
codes uses p-dimensional spins with p > 2, one can simulate these fractal codes through two-dimensional spins. 

Then, what about the bound on higher-dimensional systems with D > 2 7 Fortunately, there exist higher- 
dimensional generalizations of Sierpinski triangle constructed on a D-dimensional hypercubic lattice (see for 
example). For Z?-dimensional Sierpinski triangle with p-dimensional spins, its fractal dimension is given by 

H ^ = log ( -^^ 1 / log(p) (6) 

which approaches to 13 as p goes to infinity: Vp^^ — > D for p — !■ oo. A fractal code based on _D-dimensional Sierpinski 
triangle has fc^P' - 0{L^-^) and d - ©(L^i- ), and one can construct fractal codes which saturate the bound 
asymptotically in any spatial dimension. 

While our primary interest is in error-correcting codes which can be physically realized, it is worth considering the 
behaviors of coding properties as the spatial dimension D increases. In particular, by taking sufficiently large D and 
p, one can construct a local code with 

k^O{n^-''), d^O{n^-') (7) 

where e and e' are arbitrary small positive numbers since e' ^ 1/D. While the information storage rate R = k/n 
decreases as the system size n becomes large, the rate R decreases as slow as an arbitrary polynomial since R — 
0{n~^ ). It is interesting to observe that a good error-correcting code can be obtained by considering the limit where 
the spatial dimension of fractal codes becomes infinite. 

Discussion above is valid only if the assumption that the fractal dimension of the code distance is equal to the 
fractal dimension of Sierpinski triangle is true: 

Theorem 2 (Fractal dimension of code distance). In fractal codes, the fractal dimension of the code distance d is 
equal to the fractal dimension of Sierpinski triangle: 

k^O{L°'^) d^O{L^'"') (8) 

where Vp^^ is the fractal dimension of D-dimensional Sierpinski triangle constructed with p-dimensional spins, and 
k is the number of encodable logical p-dimensional spins. 

The rest of the paper is dedicated to the proof of this theorem. In section |lT] we discuss two-dimensional cases. In 
section [nil we discuss three-dimensional and higher-dimensional cases. In section [TV] we list possible future problems. 
The paper is written in a self-consistent way, and most of non-trivial mathematical proofs are presented in appendix, 
so the main discussion is accessible to readers both in coding theory and physics community. The main technical 
result of this paper is lemma |3] concerning the weights of raw vectors of Sierpinski triangle, which may be of interest 
by its own. 

II. TWO-DIMENSIONAL FRACTAL CODE 

In this section, we introduce local codes, which we call fractal codes, on a two-dimensional lattice and show that 
there exist fractal codes which asymptotically saturate the bound in Eq. ^ for D = 2. 

A. Definition of fractal codes 

We begin with the definition of fractal codes. Consider a two-dimensional square lattice with n — L x L spins 
where spins are p-dimensional and spin values are 0, • • • ,p — 1. We assume that p is a prime number, and L — p™ 
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with arbitrary positive integer m. Each spin is labeled by "time" t and "position" r where t,r = 0, ■ ■ ■ ,L — 1. We 
set periodic boundary conditions along the time axis, and set open boundary conditions along the position axis (see 
Fig. |3]). Note that t and r run from to i — 1, instead of running from 1 to L. 
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FIG. 3: The construction of fractal codes. The example above shows the case with p = 2 and L — 8 (m — 3). Periodic 
boundary conditions are set along the time axis. Admissible spin configurations of a fractal code can be realized as ground 
states of a three-body Hamiltonian. 

The admissible spin configurations of the system obeys the following local constraint: 

x{t + l)r = x{t)r-i + x{t)r (mod p) 0<t<L-2 (9) 

where x{t)r = 0, • • • ,p — 1 represents the spin value at (<, r). Notice that such spin configurations can be physically 
realized as ground states of the following three-body local Hamiltonian: 



H 



fractal 



n(t)^, Il{t)r = x{t + 1)^ — x{t)r-l — x{t)r (mod p) 



(10) 



with a finite energy gap. There are admissible spin configurations which can be specified by the "initial condition" 
(a;(0)o, • • • , x{0)l-i) for t = on the first raw of a square lattice (see Fig. [3|. 

The constraint given in Eq. ^ is very simple, involving only three neighboring spins at once, and is transla- 
tionally symmetric except at the boundary. Yet, the arising spin configurations have highly non-trivial patterns 
as seen in Fig. |3] Our main idea is to utilize such non-trivial structures of spin configurations for reliable encod- 
ing of information. Here, the entire system can be viewed as a "computational machine" which computes a vector 
x{t) = {x{t)o, • • • , x{t) L-i) at time t for a given initial condition x(0) — (a;(0)o, • • • , a;(0) after the time evolution 
according to the rule in Eq. In this light, our code may be considered as a physical realization of the time 

evolution of one-dimensional cellular automaton |llj . 

Now, we construct the fractal codes based on admissible spin configurations obeying Eq. (|9|. Here, we further limit 
ourselves to spin configurations which satisfy the following initial condition: 



a;(0)^ = for r > p""-^. 
This constraint may be physically realized by setting additional terms on the boundary of the lattice; 



H, 



boundary 



(11) 



(12) 



r>p" 
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We denote a space of spin configurations specified by Eq. ^ and Eq. d call it the codeword space of 

a fractal code. Coding properties of fractal codes are summarized in the following theorem. 

Theorem 3 (Two-dimensional fractal code). For the codeword space specified by Eq. ^ and Eq. (11), let k 
be the number of encodable p- dimensional spins and d be the code distance of the code (i.e. the minimal Hamming 
distance among all the possible spin configurations) . Then, we have 



k — p 



■m— 1 



1, 



p-1 
P+l 



Pip + 1) 



< d< 



p{p + 1) 



Thus, as L — becomes large, we have 
kr^O{L), 



d ^ 0{L^f' ) where P^^) ^ ( Pip+^Y ^ j ^^^^y 



(13) 



(14) 



Here, we notice that V^jf' increases as p increases. In particular, since Pp^'' 



2 for p — CX3, we can construct a 
local code which asymptotically saturates the bound k\/~d < 0{n) in Eq. ([2|. The rest of this section is dedicated to 
the proof of theorem |3] 



The reason why we limit our considerations to spin configurations obeying Eq. (Ill comes from a technical difficulty 
which is not particularly interesting. For p — 2 and an initial condition (a::(0)o, • ■ ■ , x{0) = (1, • ■ ■ ,1), the resulting 
spin configurations are {x{t)o, ■ ■ ■ ,x(i)L-i) = (0, • • • , 0) for i > which leads to d ~ L. To avoid this difficulty, we 
need Eq. ( 11 ). This is closely related to the irreversibility of the time evolution of cellular automaton for p = 2. 



B. Principal vector and fractal dimension 



Principal vector: We begin by analyzing a spin configuration specified by the following initial condition (see 
FiK.H: 



x(0)o = l, a;(0), = (r ^ 0). 
We denote spin values of the t-th row in such a spin configuration as B{t) where 

B{t) - {x{t)o,--- ,x{t)L-i) 

and call them principal vectors. For example, with m = 2 and p = 2, we have the following principal vectors: 
i?(0) = (1,0,0,0), 5(1) = (1,1,0,0), 5(2) = (1,0,1,0), i?(3) = (1, 1, 1, 1). 



(15) 



We represent the spin configuration associated with the initial condition in Eq. ( 15 1 as an L x L matrix, and denote 
it by B. For example, with ni — 2 and p — 2, we have 



B = 



1, 0, 0, 

1, 1, 0, 

1, 0, 1, 

1, 1, 1, 1 



We show several other examples of B and B{t) in Fig|4j We call B the Pascal matrix modulo p due to its resemblance 
to Pascal's triangle which is also known as Sierpinski triangle. 

Fractal dimension: Entries in principal vectors and the Pascal matrix can be derived easily from a simple formula. 
The lemma below summarizes how to compute the r-th entry of a principal vector B{t), denoted as B{t)r, for arbitrary 
t and r. 
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(c) P=5 
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{d) p=7 
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FIG. 4: Examples of principal vectors B{t) and the Pascal matrices B. (a) p = 2 and m = 3. (b) p = 3 and m — 2. (c) p — 5. 
(d) p = 7 and m = 1. 

Lemma 1 (Entries of the Pascal matrix). Let us represent t and r in p-adic forms: 

m 

r = {rjn,rm~i,- ■ ■ ,ri)p, r = ^ p™ "V^/ 

m' — l 
m 

t — (tm 1 tm— ^ — ^ ^ P tyyi' 

m' — l 

where rj and tj are positive integers with < rj,tj < p — I. Then, we have 



where tCr — for r > t. In particular, 



B{t)j, = fCr {mod p) 



tCr — Y\ t^,Cr^, 



and 



tCr ^ (mod p) iff tm' > r„ 



for all to'. 



(16) 



(17) 



(18) 



We skip the proof of lemma [T] Some examples are shown in Fig. [Sj As a direct consequence of the lemma above, 
we have the following corollary on the weight of the Pascal matrix B (See Fig. [6]): 
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FIG. 5: Entries of the Pascal matrix, t and r are represented in p-adic forms, (a) p = 2 and m = 3. Shaded entries represent 
one, while unfilled entries represent zero, (b) p = 3 and m — 2. Shaded entries represent one, black entries represent two, while 
unfilled entries represent zero. 



Corollary 1 (Fractal dimension). For principal vectors B(t), we denote its Hamming weights (the number non-zero 
entries) as W{B{t)). Similarly, we denote the Hamming weight of a the Pascal matrix B as W{B). Then, the number 
of spins with non-zero entries is 



L-l 



W{B) = J2 W{B{t)) 



p{p+l] 



(19) 



Thus, the fractal dimension of the Pascal matrix B is 



W{B)=L^f' where = log ( ^^^ ^^^ ^ / \ogp. (20) 

Proof. When p = 2, the number of non-zero entries corresponds to the number of pairs of t and r such that 

tm' > fm' for all m' 
from lemma [1] Then, we notice that only the following three pairs of tm',rjn' are allowed: 

(i™',r™0 = (0,0), (1,0), (1,1). 
Therefore, in total, there are 3™ non-zero entries. For p > 2, there are ^^^.^^-^ possible pairs of tm' and r^/. Therefore, 



in total, there are ^^^^^^^^ non-zero entries. 



□ 



C. Time evolution of principal vectors 

We have analyzed a spin configuration B arising from an initial condition B{0) = (1, 0, 0, 0, • • • ). In this subsection, 
we extend our analysis to spin configurations arising from arbitrary initial conditions. 

Let us denote an arbitrary initial condition as V^(0) and its t-th raw as V{t). Since principal vectors B(t) are 
independent, one can decompose 1^(0) as a linear combination of B{t): 



L-l 

E 

t=0 



V{0) = y c{t)B{t) (mod p) 



(21) 
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FIG. 6: Examples of fractal dimensions for p = 2,3, 5. 



where c{t) = 0, ■ ■ ■ ,p — 1. Then, our goal is to find an expression for V{t) in terms of principal vectors B(t) for 
arbitrary t. 

Lemma 2 (Time evolution). We define B(L + a) = 2B{a) for a > 0. Then, when V{0) = J^t c(''")-S(t), we have 

V{t) ^^c{t)B{t + t) (modp). (22) 

r 

When V{0) — B{t) (r ^ 0), the time evolution is 

B{t) B{t + 1)^ > B{L -1)^0^ >0 

for p = 2, while 

B{t) ^ B{t + 1)^ > B{L - 1) ^ 2B(0) ^ > 2B{t - 1) 

for p>2. 

While we are primarily interested in fractal codes with periodic boundary conditions, one may generalize the analysis 
to fractal codes with open boundary conditions. In such cases, the time evolution is slightly modified since B{L — 1) 
always evolves into -B(O) regardless of p: i?(L — 1) — > i?(0). A similar discussion holds for codes with open boundary 
conditions, and one can obtain a similar bound on the code distance. 



D. Inequality on principal vectors 



Finally, we prove theorem [3j Our proof relies on the following lemma on the weights of vectors represented in terms 
of principal vectors: 

Lemma 3 (Inequality on principal vectors) . Consider the following linear combination of principal vectors: 

L-l 
t=Q 

and denote the smallest positive integer t such that c{t) ^ as tmin- Then, for the Hamming weight ofV(0), we have 

W{ViO)) > W{B{t^,„)). (23) 
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This is one of the most important technical tools obtained in this paper. The proof is presented in appendix A 2 
It is worth looking at an example. Let us consider the case where p = 3 and m = 2: 

B{2) = (1,2,1,0,0,0,0,0,0), 5(5) - (1,2,1,1,2,1,0,0,0), 5(7) = (1,1,0,2,2,0,1,1,0) 
B{2) + 5(5) + 5(7) = (0, 2, 2, 0, 1, 1, 1, 1, 0). 

Then, we notice 

W{B{2) + 5(5) + 5(7)) > W{B{2)) 

and the lemma holds. 

The proof of theorem [3] also requires the following fact on the self-similar properties of principal vectors: 
Fact 1. We have 

W{B{t + h ■ p™~^)) = (6 + l)W{B{t)) (24) 

forO<b <p andO<t < . 

We are now ready to prove theorem [sj We consider a spin configuration generated by an initial condition V'(O): 



F(0) = J2 <^)B{t) 



which obeys Eq. (11). We denote the smallest t such that c{t) 7^ as imm- We denote the t-th raw of the spin 



configuration as V{t), and denote the entire spin configuration matrix as V. Then, due to lemma [sj we have 

W{V{t))>W{B{t^„,+t)) for 0<i<p"-p"-i-l, 

which leads to 

w{Y) = w{v{t)) > + 



Then, by fact [T} we have 



t=o t=o 
This completes the proof of theorem [3j 



III. THREE-DIMENSIONAL FRACTAL CODE 



The construction of two-dimensional fractal codes can be generalized to higher-dimensional systems too. In this 
section, we introduce the three-dimensional version of fractal codes and prove theorem [T] for D — 3. Also, higher- 
dimensional cases with D > 3 are briefly discussed. 



A. Definition of fractal codes 



We consider a three-dimensional cubic lattice with n = L x L x L spins where spins are p-dimensional and L = 
p™. Each spin is labeled by "time" t and two "positions" r'^^ and with i,r(^\r(^) = 0, • • • ,L — 1. We set 
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periodic boundary conditions on all the surfaces which are parallel to the time axis (see Fig. [?]). The admissible spin 
configurations obeys the following constraint: 



x{t + 1)^(1) r(2) = a;(i)r(i)-i.r(2) + x{t)r(i) + x{t)j.(i) ^(2) (mod p) 



0<t< L~2 



(25) 



where x{t)^(i) ^(2) = O,--- ,p — 1 represents the spin value at (t,r^^\A^'^). Spin configurations may be uniquely 
specified by "initial conditions" a;(0) with x{0)j,(i) ,.(2) = 0, • • • ,p — 1, which may be considered as L x L matrices. 



> initial condition 




local constraint 
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1 
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t=0 



t=1 



t=2 



t=3 



FIG. 7: The construction of three-dimensional fractal codes. The example above shows the case with p = 2 and m — 2. 

We further limit ourselves to spin configurations which satisfy the following initial condition (see Fig.[7](c)): 

a;(0)^(i)^H2) - for r^^' + r^^) > (26) 

and denote a space of spin configurations specified by this condition as Cp . Then, our main result is summarized in 
the following theorem: 

Theorem 4 (Three-dimensional fractal code). For the codeword space Cp , let k be the number of encodablc p- 
dimensional spins and d be the code distance of the code. Then, we have 



j_ (p"'-^ + l)(p"'-^+2) /p-l\ / p(p+l)(p + 2) \'" / p{p+l){p + 2] 

2 ' {p + 2j\ 6 J - -\ 6 



where L — . Thus, we have 



k - 0(L), d - 0{L^v'' ) where Vf^ = log 



p{p + l){p + 2) 
6 



/log(p)- 



(27) 



(28) 



When = 3, the fractal dimension goes to three: Vp ' — 3 for p — oo. Therefore, the code saturates the bound 
kd^l^ < 0{n) in Eq. ^ for £) = 3 asymptotically. Below, we present the proof of theorem [i] 



B. Principal matrix 



Let us begin by analyzing a spin configuration specified by the following initial condition: 

a:(0)o,o = l, x(0),(i)_,(2, = for (r«, r^^)) ^ (0, 0) 



(29) 
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which may be represented in the following matrix form: 



5(0,0) 



1, 0, 
0, 0, 



• 

• 



.0, 0, ••• 0. 



(30) 



We denote the spin configuration tensor, generated by the initial condition -6(0, 0), as B, and call it the Pascal tensor. 
We also denote a matrix representing a spin configuration on the t-th layer of the Pascal tensor B as B{0, t), and call 
them principal matrices. Therefore, the time evolution of the initial condition _B(0,0) may be represented as follows: 



B{0,0) -8(0,1) 
When p = 2 and m = 2, principal matrices are 



B{0,L- 1). 



B(0,0) 



1, 0, 0, 

0, 0, 0, 

0, 0, 0, 

0, 0, 0, 



B(0,1) 



1, 1, 0, 

1, 0, 0, 

0, 0, 0, 

0, 0, 0, 



S(0,2) 



Other examples are shown in Fig. [8j 



B(0,0) 



B(0,1) 



1, 0, 1, 

0, 0, 0, 

1, 0, 0, 
0, 0, 0, 



B(0,2) 
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(31) 



B(0,3) 



1, 1, 1, 1 

1, 0, 1, 

1, 1, 0, 

1, 0, 0, 



FIG. 8: Examples of principal matrices B(0,t) for p = 5 and m — 1. 

Now, we derive a formula to find spin configurations of principal matrices B{0,t). For < t,r'-^),r(^) < L — 1, we 
define 



tCr(i),ri2) 



r(i)!r(2)!(t - - r(2))! 



(32) 



The lemma below summarizes how to compute the entry at {r^-^\ r'^-*) in B{0, t), denoted as -6(0, i)r(i)^(2) , for arbitrary 
t, r(i) and r^^): 
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Lemma 4 (Entries of the Pascal tensor). Let us represent t, r^^^ and r^"^^ in p-adic forms: 

m' — 1 
m' — 1 

t — {tmtm-1 ■ ■ ■ tl), t— ^tm'- 



Then, we have 



In particular, 



B{0,t)j.(i) J.C2) — tCj.{i) r(2) {modp). 



(33) 



(34) 



and 



tCr(i)^r(2) 7^ {modp) iff t„i, > rll} + rl^J for all m' 



(35) 





00 


01 


10 


11 


00 


oCo.o 


oCi,o 


0C2,0 


0C3,0 


01 


oCo,i 


oCi.i 


oC2,1 


0C3.I 


10 




oCl,2 


oC2,2 


oC3,2 


11 


oCo,3 


oCl,3 


oC2,3 


oC3,3 



B(0,0) t=00 

■ 



iCo.o 


iCi,o 


lC2,0 


iCa.o 


iCo,i 


iCi,i 


1C2,1 


1C3,1 


lCo,2 


lCl,2 


lC2,2 


lC3,2 


1C0,3 


1C1,3 


1C2.3 


1C3,3 



B(0,1) t=01 



2Co,0 


2Cl,0 


2C2,0 


oCs.o 


2C0,1 


2C1,1 


2C2,1 


oCs.i 


2Co,2 


2Cl,2 


2C22 


oC3.2 


2Co,3 


2Cl,3 


2C2,3 


oC3,3 



B(0,2) t=10 



3Co,0 


3Cl,0' 


3C2,0 


0C3,0 


3Co,1 


3C1,1 


3C2,1 


3C3,1 


3Co,2 


3Cl,2 


3C2.2 


3C3.2 


3Co,3 


3C1,3 


3C2,3 


3C3,3 



8(0,3) t=11 



FIG. 9: Entries of principal matrices for p = 2 and m = 2. 

An example is shown in Fig. |9] The proof is skipped. As a direct consequence of the lemma above, we have the 
following corollary on the weight of the Pascal tensor B: 

Corollary 2 (Fractal dimension). The number of non-zero entries in the Pascal tensor is 

L-l 



t=o 



WiB) = J2wiBiO,t)) 

Thus, the fractal dimension is 

W{B) = L 



p(p+l)(p + 2) 
6 



^'■^'^ where Vf^ = log ( fcil(^i±2) ^, / j^g^. 



(36) 



(37) 



Proof. In order for i3(0, t)r(i) ,,(2) to be non-zero, (^m' ) must satisfy t^' > r^^J + r^J for all m'. The number 
of such choices for each m' is 

+ ^ p(p+l)(p + 2) 
^2 6 ■ 



□ 



14 



We continue our analysis on basic properties of principal matrices B(0,t). We introduce the following shorthand 
notation of principal matrices B{0,t): 



B(0,t) 



■ B{Q,t)o 
5(0, t)i 



(38) 



where B{0,t)j are L-componcnt vectors with 

5(0, % = (B(0,t)oj,5(0,t)i,j,--- ,B(0,i)i_ij). 
For example, when p = 2 and m = 2, we have 



(39) 



5(0,3) 



1, 1, 1, 1 

1, 0, 1, 

1, 1, 0, 

1, 0, 0, 



and 



B(0,3)o = (1,1,1,1), B(0,3)i = (1,0,1,0), 5(0,3)2 = (1,1,0,0), 5(0, 3)3 = (1, 0, 0, 0). 
Therefore, one may represent 5(0,3) as follows: 



5(0,3) = 



5(3) 
5(2) 
5(1) 
5(0) 



where 5(0), 5(1), 5(2) and 5(3) arc principal vectors used in analyzing two-dimensional fractal codes. We also have 



5(0,2) 



As examples above show, principal matrices 5(0, i) can be concisely represented in terms of principal vectors 5(i). 
Other examples are shown in Fig. 10 too. One may represent principal matrices 5(0, t) in terms of principal vectors 
B{t) as follows: 

Lemma 5 (Principal matrix). A principal matrix 5(0, t) can be represented as 



"1, 


0, 


1, 







5(2)' 


0, 


0, 


0, 










1, 


0, 


0, 







5(0) 


0, 


0, 


0, 











5(0,0 



5(t)o • Bit) 
Bit), -Bit -I) 



(40) 



_Bit)L-i-Bit-L + l)_ 

We skip the proof as it is straightforward. As an example, let us represent 5(0, 6) for p — 2 and to = 3 in this 
shorthand representation (see Fig. 10 1: 



5(6) = (1, 0, 1, 0, 1, 0, 1, 0), 5(0, 6) = (5(6), 0, 5(4), 0, 5(2), 0, 5(0), 0)^ 
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where represents vectors with zero entries. Similarly, we can represent B(0, 7) for p = 3 and m = 2 as follows: 

B{7) = (1,1,0,2,2,0,1,1,0), B(0,7) - (5(7), 5(6), 0, 25(4), 2B(3), 0, 5(1), B(0), Of. 

It is worth representing all the principal matrices 5(0, t) at once as in Fig. |10[ b). Therefore, in a principal matrix 
5(0, t), principal vectors 5(0), • • • ,5(t) are distributed with weights corresponding to a principal vector B{t). 
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B{0,6) (b) B{0,0) B{0,1) B{0,2) B{0,3) B(0,4) B{0,5) B{0,6) B{0,7) 
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B(S) 



2B(4) 
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B(S) 
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B(0) 



FIG. 10: (a) Shorthand notations of -6(0, 6) for p = 2 and m — 3, and 5(0, 7) for p = 3 and m — 2. (b) Principle matrices and 
principal vectors. 



C. Generalized principal matrix 

So far, we have analyzed the spin configuration generated by the following initial condition: 



5(0,0) = 



5(0) 






(41) 



In this subsection, we generalize our analyses and consider spin configurations generated by other initial conditions: 



5(a,0) 



5(a) 






(fora = 0, ••• ,L-1). 



(42) 



We denote the t-th layer of the spin configuration generated by 5(a,0) as B{a,t). For simplicity, we will call B{a,t) 
for both a = and a principal matrices from now on. 
One may represent B{a,t) explicitly as follows: 
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Lemma 6 (Generalized principal matrix). A principal matrix B{a,t) can be represented as 



B{a,t) 



B{t)o ■ B{t + a) 
B{t)i -Bit + a-l) 

B{t)L-i- B{t + a- L+1) 



where B{t + L) = 2B{t). 
Below, we show some examples. For p = 2 and m = 2, we have: 



5(0,0) 



5(1,0) 



5(2,0) 



5(3,0) = 



5(0) 




5(1) 




5(2) 




5(3) 






, 5(0,1) = 


B(0) 



, 5(0,2) = 




5(0) 


, 5(0,3) = 


B(2) 
5(1) 


n 




n 

u 






u 






5(1)" 




"5(2)" 




"5(3)" 











, B{1,1) = 


5(1) 



, B{1,2) = 




5(1) 


, 5(1,3) = 


5(3) 
5(2) 

















5(1)_ 


5(2)" 




5(3)" 
















, B{2,1) = 


5(2) 



, 5(2,2) = 




5(2) 


, 5(2,3) = 




5(3) 

















5(2)_ 


6(3)" 





















, 5(3,1)- 


5(3) 



, 5(3,2) = 




5(3) 


, 5(3,3) = 





















5(3) 



For p = 3 and m = 1, we have 

5(0,0) 



5(0) 5(1) 5(2) 

, 5(0,1)= 5(0) , 5(0,2)= 25(1) 
J [ J [-B(O) 

5(1)1 r5(2)1 [25(0) 

5(1,0)= , 5(1,1)= 5(1) , 5(1,2)= 25(2) 
J |_ J L^(l). 

5(2)1 [25(0)1 [25(1)' 

5(2,0)= , 5(2,1)= 5(2) , 5(2,2)= 5(0) 
J [ J [b{2) 

Now, let us analyze the time evolution of principal matrices. Recall that 5(a, 0) evolves as follows: 

5(a, 0) B{a, 1) -s- 5^ 5(a, L - 1). 

Here, we are interested in the time evolution of B{a,T): 



(43) 



(44) 



Lemma 7 (Periodic boundary conditions). We define B{a,L + t) = 3B{a,t). When the initial condition is V{0) = 
B{a, t), we have 



V{t) = B{a,T + t). 



(45) 
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D. Inequality on principal matrices 



Finally, we prove theoreiii|4j We begin by noticing that there are principal matrices and they are all independent. 
Then, one can decompose an arbitrary initial condition V{Q) in terms of principal matrices B{a,t): 



F(0)=^c(a,t)i?(a,t). 

a.t 

Since the initial condition must obey Eq. ([26|, we have 

c(a,t)=0, for a + t>p"'-\ 

Next, we define the following sets: 

Ro{V{0)) = {ia,t):cia,t)^0} 

Ri{V{0)) = {{a,t) e RQ:a + t<a' + t' for ah (a',<') G Rq} 
R2{V{0)) = {(a,<) e Ri:t<t' for ah (a',t') G Ri}. 



(46) 



(47) 



(48) 



Note that i?2 Q Ri Q Ro, and there is only one element in i?2- Examples of Rq, Ri and R2 are shown in Fig. 11 
Then, for the weight of the initial condition, we have the following inequality: 



t 



R2 



Rq 

FIG. 11: Examples of Ro, Ri and R2. Ro is a set of all shaded sites. Ri is a set of sites with minimal a + t. 7?2 is a subset of 
Ri with minimal t. 



Lemma 8 (Inequality on principal matrices). Consider a matrix 

y(0)=^c(a,i)S(a,t) 

a,t 

where c{a,t) — for all {a,t) with a + t > L. Let {a' ,t') G R2{V{0)). Then, we have 

W{V{0)) >W{B{Q,t')). 

The proof is presented in appendix ??. As an example, let us consider the following linear decomposition: 

V{Q) = B{2, 3) + B(5, 3) + B(l, 4) + B(0, 8). 



(49) 



(50) 
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Then, we have 

= {(2,3), (5,3), (1,4), (0,8)}, i?i = {(2,3),(l,4)}, i?2 = {(2,3)} 

and 

WiV{0)) > W{B{0,3)). 
Now, we prove theorem [4j Consider the time evolution of an initial condition: 

= (51) 



a.t 



Let i?2(V'(0)) = {{a',t')}. Then, we have R2{V{t)) = {{a',t + t')} ior t < L - Then, we have 

t=0 t=0 

Due to fact [ij one has 

E W^(i?(0, i)) > '"E " WiBiO, t))=(^^- '^P^P + 1) ^ ^^(^ + + 2) ^ 
t=t' t=o 



p-1 ^X)£3) 



6 y V 6 



p + 2 

This completes the proof of theorem |4j 

E. Higher-dimensional fractal code 

Finally, we briefly discuss the D-dimensional fractal codes for D > 3. Most of proofs are skipped since they are 
complicated, but straightforward to obtain. We consider a Z?-dimensional hypercubic lattice with n = L x ■ ■ ■ x L 
spins with L = p'". Each spin is labeled by "time" t and "positions" r^^^, • • • , r^^~^\ and we set periodic boundary 
conditions on all the _D — 1-dimensional surfaces which are parallel to the time axis. The admissible spin configurations 
of the lattice obeys the following constraint: 

a:(t + l)r = .T(i)r + E ^W"--e, (mod p) 0<t<L-2 (52) 

where r = {r^'^\ ■ ■ ■ and is a unit vector in the r^-*^ direction. In addition, we limit ourselves to spin 

configurations which satisfy the following initial condition: 

D-l 

x(0)r = for E > (52) 

and denote a space of spin configurations specified by the condition above as Cp^\ Then, we have the following 
theorem. 
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Theorem 5 (Higher-dimensional fractal code). For the codeword space Cp^\ let k be the number of encodable spins 
and d he the code distance of the code. Then, we have 



k 



where L — p'" . Thus, we have 



{D-l)\ 



p-1 



L'^p <d< L'^p 



k - 0{L^'^), d - 0{L^p ) where V^^^ = log 



P + D-l 

p{p+l)---{p + D-l) 



Dl 



/log(p)- 



(54) 



(55) 



as L becomes large. 

The fractal dimension Vp^^ goes to D: Vp^^ — > for p — > oo. Therefore, the code saturates the bound kd^^^ < 
0{n) in Eq. ^ asymptotically for arbitrary D. 

Here, we only give a sketch of the proof. We begin by defining {D ~ l)-dimensional principal tensors. Recall that 
we have defined two-dimensional principal matrices from one-dimcnsional principal vectors by using one-dimensional 
principal vectors as initial conditions. Here, (I) — l)-dimensional principal tensors can be constructed recursively from 
(I) — 2)-dimensional principal tensors. In particular, a (D — l)-dimcnsional principal tensor B(r,t) with {D — 2)- 
dimensional vector r is defined as the time evolution of B{r, 0): 



B(r,0) 



B{rj 






(56) 



where B{r) is a (D — 2)-dimensional principal tensor. 

With these independent {D — l)-dimensional principal tensors B{r,t), one can decompose an arbitrary {D — 1)- 
dimensional tensor uniquely. Now, we need to obtain an inequality to bound the weight of (£) — l)-dimensional tensors. 
For the decomposition 

D-2 

V{0) = c(r, t)B{r, t) where c(r, t) = for all t + ^ > L, (57) 



we define the following sets with Rd-i Q ■ ■ ■ Q Ri Q Ro- 

Rq = {{ri,- ■ ■ ,rD^i) : c(ri, • • • , r^i^i) 7^ 0} 

D-l D~l 

Ra = {{n, ■ ■ ■ ,rD-i) e Ra-i : '^rj <Y^ r'^ for aU (r^, ■ 



ri3_i)ei?,„i}. 



(58) 



Then, assuming that (rj^, • • • ,r'j^_^ E Rd-i, we have 

W{V{Q))>W{B{0,r'o_,)) 



(59) 



This bound can be proven by using the machineries which are very similar to the proof techniques used for lemma [8] 
As a result of this bound, one can easily obtain a lower bound for the weight of arbitrary spin configurations arising 
in Z?-dimcnsional fractal codes. 



IV. OPEN QUESTIONS 



In this paper, we have constructed local codes, called fractal codes, which asymptotically saturate the theoretical 
upper limit on the information storage capacity of discrete spin systems. These fractal codes are essentially the best 
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physically realizable error-correcting codes, and may be actually manufactured in real physical systems in the future 
when necessary technologies become available. 

An immediate future problem concerns whether there exists a local code which exactly saturate the bound or not. 
Below, we present other possible future problems as well as some comments on implications of our results. 

1. Time evolutions of arbitrary cellular automaton, based on linear update rules, can be physically realized as 
ground states of local Hamiltonians. It would be interesting to find other classes of local codes with fractal 
properties and analyze their coding properties. 

2. Currently, a connection between the bound in Eq. ^ for discrete spin systems and the Bekenstein bound for 
continuum systems has not been established yet. Since two bounds address similar questions from different 
aspects, it may be possible to develop a theoretical framework to discuss both bounds on the same footing. 
Note that fractal codes can be represented as spin network states [7] in their generalized interpretation. 

3. While our discussion in this paper is limited to classical error-correcting codes, finding a quantum analog of 
fractal codes may be an interesting future problem. Note that the bound on the information storage capacity 
for local quantum codes was given in 5j. Perhaps, a construction similar to our fractal codes may give local 
quantum codes which asymptotically saturate the bound. 

4. Experimental realization of fractal codes is an important future problem. The biggest obstacle in physically 
realizing fractal codes is the fact that it involves three-body interactions which may not exist in natural physical 
systems. Yet, it may be possible to simulate three-body terms through two-body terms perturbatively |12j or 
non-perturbatively |13) . 

5. Finding local codes supported by frustration- free local Hamiltonians is fundamentally akin to searching for 
novel quantum phases since frustration-free Hamiltonians can be used as candidates of quantum phases with 
which one can classify physical phases [Mj. Therefore, a problem of finding physically realizable codes, which 
is of practical importance in coding theory community, is also of fundamental importance in condensed matter 
physics community. 

6. Recently, the author has argued that all the frustration-free systems with continuous scale symmetries can 
be described effectively by topological quantum field theory via a complete classification of two and three- 
dimensional stabilizer codes with continuous scale symmetries [15 . However, it seems that frustration-free 
systems with discrete scale symmetries, such as fractal codes discussed in this paper, are beyond descriptions 
of topological quantum field theory. It would be interesting to search for effective theories for systems with 
discrete scale symmetries. 
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Appendix A: Proofs of some lemmas 

In this appendix, we give proofs of some lemmas used in the main discussion. 
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1. Self-similarity 



First, it is worth observing basic properties of the Pascal matrix B. As seen in Fig. |4j the Pascal matrices B have 
fractal properties with self-similar structures. In particular, as shown in Fig. |12[ a), similar patterns of spin values 
appear repeatedly at various length scales. Such self-similar structures are summarized as follows: 

Fact 2 (Self-similarity). We denote the Pascal matrix for L = p'" as B^"'\ Then, we have 
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FIG. 12: (a) An example of a self-similar property for p = 3. B'^' appears repeatedly as submatrices of B*-^'. (b) Self-similar 
properties at different length scales. 

Therefore, B*-™"^-* appear repeatedly as submatrices of B'™-*. It is worth looking at an example for p — 2. Then, 
we notice that 



B 



(1) 



1, 
1, 1 



B 



(m) 



B 



(m-l) 







g(m-l) g(m-l) 



(A2) 



where represents a 2™ ^ x 2™ ^ matrix whose entries are all zeros. An example for p = 3 is shown in Fig. 12 

2. Proof of lemma [3] 



The proof of lemma [3] consists of several non-trivial steps. 

Inverse matrices: In order to capture the properties of the Pascal matrix B, it is worth finding its inverse matrix. 
The inverse B~^ is related to the original matrix B through the following simple rule: 
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Lemma 9. We denote the inverse matrix of B as B ^ : 



B B^ =1 

where I is an identity matrix, and the matrix multiplication is computed modulo p. 

(a) The inverse matrix is given by: 

B-\t)r = B{L-l-r)L-i-t 
where B^^{t)r represents an entry of B^^ at {t,r). 

(b ) The entries of the inverse matrix is given by 

B-\t)r = L-l-rCL-l-t = {-if+'tCr = {-1)'+^ B{t\ 
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FIG. 13: Examples of the Pascal matrices and its inverse matrices. Only the shaded regions with t + r — odd may have different 
entries in B and B~^. The inverse matrices can be obtained by reflecting the original matrices along the arrows shown above, 
(a) p = 3 and m = 2. (b) p = 7 and m = 1. 



Examples of inverse matrices are shown in Fig. 13 Note that the inverse matrix B ^ can be obtained by taking a 
reflection of the original matrix B. 



Proof. Since B ^{t)r = B{L — 1 — r)L_i_t, we have 



B-\t)r 



L-l-rCL-l-t 



(p™ - i) • • • (p"" - 1 - r) 

(-t)(-^+l)...(-l-r) 

(t-r)! 
{-ir^{r + l)---{t-l)t 



{t-r)\ 



(-l)*+''<! 
r\(t-r)\ 

(-i)*+^a 
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for t > r where all the calculations are carried out modulo p. It is straightforward to see that B • B "'^ = I with some 
calculations. □ 

The inverse matrix can be also obtained by taking the powers of the original matrix: 

Lemma 10. Consider spin configuration matrices generated by the following modified rule 

x{t + l)r = x{t)r^i^ cx{t)r {mod p) Q<t<L-2 (A6) 

where c is a positive integer with an initial condition 

a;(0)o = l, x{0)r = (r ^ 0). (A7) 

We denote such spin configuration matrices as R^"^^ . Then, we have 

B^ = R^''\ (A8) 

Therefore, by modifying the local rule for spin configurations, one can obtain powers of the Pascal matrix easily. 

(A9) 



An example is shown in Fig. 14 Here, we notice that R^''^ = I since the update rule is reduced to 

x{t + l 

Also, we notice that R^^"^^ = B"^ 
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FIG. 14: Examples of powers of the Pascal matrix B for p = 5. 
Proof. For simplicity of discussion, we only prove B^ = R^^''. Since 

B{t)r ^ B{t - l)r + B{t - l)r-l, 
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we have 



a 

= - l)a + B{t - l)a-l)B{a)r 

a 

= - 1), + Y,B{t- l)a-lB{a)r 

a 

= B^{t - 1), + 51 ^(^ - l)aS(fl + l)r 

a 

= B^{t - 1), + - l)aB(a)r + S(a),,_i) 

a 

= B'^{t - l)r + B^{t - l)r + B^{t - l)r-l ^ 2B^ {t - l)r + B^ {t - l)r-l 



where B{t)a = for i < 0, and B{t)a = B{t)a+L if a < 0. Then, we notice that entries of obeys the rule in Eq. (25) 
for c = 2. Therefore, can be generated from the rule for c = 2. In a similar way, one can prove B'^ ~ R*-'^-'. □ 

Submatrices of the Pascal matrix: The the Pascal matrix B is invertible since principal vectors Bit) are 
pairwise independent. Similar properties holds for submatrices of B. We denote the Pascal matrix B for m = 1 as 
B(i): 



bW = 



qC'o, qCi, 0C2, •■■ oCp-i 
iCoi iCi, 1C2, ••• iCp_i 



(mod p) 



(AlO) 



Lp-lC'o, p-lC*!, P-1C2, ■ ■ ■ p_iCp_i_ 

which is a p X p matrix. Then, for submatrices of B*-^', we have the following lemma: 
Lemma 11. Consider the following submatrix oj B^^\ denoted as A: 

a^o^Oi xqCi^ xqC2^ ' ' ' x^Ca 
.TiC'o, xiClj XlC2^ ■•• xiCa 



xCo, xCi, xC2, 



(All) 



where a < p and < Xq < Xi < ■ ■ ■ < Xa < p- Then, A always has an inverse matrix A ^ . Similarly, consider the 
following submatrix of B^^\ denoted as A': 



A'- 



p— a— lC*yQ, p—a—lCy^^ p—a — lCy2 

p-2Cyg, p_2Cyj, p_2Cj^2 7 

. p-lC'yo, p~lCyn p-l^y2i 



p—a— 1 
p~2Cy^ 

p-lCy^ 



(A12) 



where < ya < yi < ■ ■ ■ < ya < P- Then, A ' always has an inverse matrix {A') ^ . 

The construction of A goes as follows. First, we choose an p x a submatrix from B*-^-' on the left hand side of 
B(i) (a < p). Then, we pick up a raws to create an a x a matrix A. Similarly, to construct A', we choose an a x p 
submatrix on the bottom of B*-^-', and pick up a columns to create an a x a matrix A'. Examples of such constructions 
of submatrices are shown in Fig. |15[ 
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It is worth looking at examples. Consider the case where p = 5. Then, we have 



B(i) = 



For a = 2 and xq = 2, xi = 3 and X2 = 4, we have 



1, 0, 0, 0, 

1, 1, 0, 0, 

1, 2, 1, 0, 

1, 3, 3, 1, 

1, 4, 1, 4, 1 



1, 2, 1 
1, 3, 3 
1, 4, 1 



(A13) 



(A14) 



Since three vectors (1,2,1), (1,3,3) and (1,4,1) are independent (mod 5), A is invertible. For a = 2 and j/o = Ij 
yi — 2 and y2 — 3, we have 



A' = 



2, 1, 

3, 3, 1 

4, 1, 4 



(A15) 



which is also invertible. 



Proof. For simplicity of discussion, we present a proof only for A. First, recall that the Vandermonde matrix M has 
the following well-known property: 



M 



1, Xq, Xq, 
1, Xi, xf, 



det(M) 



n 



(A16) 



0<i<j<a 



_1; Xaj ' ' ' : ^ 

Therefore, the following vectors are independent when Xi ^ Xj for all i and j: 

(1: 1; ' ' ■ : l)i (s^Oi • • ■ , Xa) ■■■ (Xg , , ' ' ' , X ^) . 



(A17) 



Now, let us consider the Vandermonde matrix modulo p. When < xq < xi < ■ ■ ■ < Xa < p, the vectors above are 
independent modulo p since the determinant of M computed modulo p is nonzero. Notice that our goal to prove that 
the following vectors are independent modulo p: 



{xqCqj xiCqj ' ' ' I a;<iCo)j (soC*!, a;iCl) ■ ' ' j x^Ci) 



{xq C a 1 xi : ' ' ' ^ Xa ^a) • 



(A18) 
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This is immediate since vectors in Eq. ( A18[ ) can be created by adding vectors in Eq. ( A17). Therefore, A is invertible. 
A similar proof works for A' by using lemma |9] □ 

Proof of lemma [3j Finally, we prove lemma [3] Due to the self-similar structures of the Pascal matrix B, it is 
sufficient to prove the lemma for m 1. Consider a decomposition 

t 

where tmm is the minimal integer such that c{t) ^ 0. Then, the goal is to prove 
We list all the integers r such that 

^ and V{0)r = 

and denote them as ri, • • • , Tq. Then, the number of non-zero entries of V{0)r for r < tmin is W{B(tmin)) — o,. Next, 
we list all the integers r such that 

B(imm),. = and ^(0), = 

and denote them as r'j^, • • • , r^. Then, the number of non-zero entries of ^(0)^ for tmin < r is [p—l — tmin) — b. Then, 
we have 

W{ViO)) = M/(S(i„„„)) -a + {p-l- f„,„0 - b 

from a simple counting argument. Therefore, it suffices to prove that a + b<p— 1 — tmin. 
We next consider constrains on coefficients c{t): 

p-i 

^(0)r = 5IcW^W- = r = ri,--- ,ra,ri,--- ,r^. 

t=0 

Recall that t„im is the minimal t such that c{t) ^ and cit) = for t < t„iin- Then, the above constraints can be 
concisely represented as follows: 



(A') 



. c(p-l) . 



where 



A' 



B{p- l)r^, B(p-l),.;, B{p-1) 
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Here, A' is a (p — tmin) x (a + b) matrix. Notice that the rank of A' is p — tmin when a + b > p — tmin due to lemma 
In such cases, we have c{t) — for all t which leads to a contradiction. Therefore, a + b < p — tmin- This leads to 
M^(y(0)) > W{Bmin), and completes the proof of lemmajs] 



3. Proof of lemma [H 



We begin by proving the following lemma. 
Lemma 12. We have 

WiV{0))>wl c{a,t)Bia,t) 

\(a,t)eRi(V{0)) 

Proof. We decompose V{0) as follows: 

F(0) = c{a,t)B{a,t) + ^ c{a,t)B{a,t) + ^ c{a,t)B{a,t) 



a+t=0 



a+t=l 



a+t=2 



In particular, we set 



T/(0) = ^F(0)(*), nO)(')= E c{a,t)B{a,t). 

S a+t=S 



For simplicity of discussion, we consider the case where 

F(o) = y(o)(*) + y(o)(*+i). 

V{Q)''^^ can be represented as follows: 

d{6) ■ B{S) 
d{6-l)-B{S-l) 



ViO) 



(■5+1) = 



d{0) ■ B{0) 




where d{0), ■ ■ ■ ,d{S) are some integers, and V{0)^^~^^^ can be represented as follows: 

d'iS + l)-B{5 + l) 
d'{d) ■ B{5) 



F(0) 



(<5+l) = 



d'(0) • B(0) 




where d'(0), • • • , d'{5 + 1) are some integers. Then, we have 



d'{6 + l)-B{5 + l)+d{5)-B{5) 
d'{6)- B{6)+d{5-l)- B{6-1) 

d' {\) ■ B{1) + d{Q) ■ B{{)) 
d'(0) • B{Q) 
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Then, due to lemma [3j we have 

w{vio)) > wivioY^'>). 

The discussion above can be easily extended to general cases. This completes the proof. 



□ 



Next, it is convenient to consider the transposes of principal matrices. Let us begin with an example. When 
V{0) B{1, 1) for p = 2 and m = 2, we have 



5(2)" 




"l. 


0, 


1, 


o" 


B{1) 




1, 


1, 


0, 










0, 


0, 


0, 










.0' 


0, 


0, 






Then, its transpose is 





1, 


0, 







B{1) 


0, 


1, 


0, 







B{0) + B{1 


1, 


0, 


0, 







BiO) 


0, 


0, 


0, 











Here, we apply lemma 12 to B{1, 1)^: 

= (B(l,inW + (i?(l,lf)(2) 

where 



B{1) 
B{0) 







= i?(0,l), {B{l,lfY'^ = 





B{1) 
B{0) 




and 



w{v{o)) > w{{B{i, ly y^>) = w{b{o, i)). 

As the example above shows, by considering the transpose of principal matrices, one can further lower bound on 
the weight of principal matrices. For this purpose, the following lemma is particularly useful. 



Lemma 13. Consider the decomposition of B{a,t)^ with a + t < L: 

B{a,tf = Y,c{a\t')B{a',t,). 



Then, we have 



R,{B{a,tf)^{{Q,t)}. 



(A22) 



(A23) 



The proof of the lemma 13 is immediate by noticing the following fact: 
Fact 3. The principal matrices B{0,t) are symmetric under the transpose: 

B{0,tf = B{Q,t). 



(A24) 
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The principal matrix B{a, t) for a ^ Q is given by 

B{a,t) = ^T;(7-/(i3(a). • B{Q,t)), (A25) 

X 

and its transpose is given by 

B{a,tf ^Y.T%'{B{a)^ ' ^(0,*)), (A26) 

y 

We finally prove lemma [Sj For the decomposition 

F(0)=^c(a,t)i?(a,t), 

we define 

F(0)*= ^ c(a,t)B{a,t). 
(a,t)e-Ri(y(o)) 

Then, we have 

W{V{Q)) > W{V{0)*). 
Here, we consider the transpose of V{0)* . Then, for {a' ,t') e R2{V{0)), we have 

Rii{Viorf) = iOX)- 

Therefore, we have 

w{v{o)*) = w{{v{oyf) > w{B{o,t')). 

This completes the proof. 
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